<!doctype html public "-//w3c//dtd html 4.0 transitional//en">
<html>
<head>
  <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
  <meta name="Author" content="Doug Cutting">
</head>
<body>
A grammar-based tokenizer constructed with JavaCC.
<p>Note that JavaCC defines lots of public classes, methods and fields
  that do not need to be public.&nbsp; These clutter the documentation.&nbsp;
  Sorry.
<p>Note that because JavaCC defines a class named <tt>Token</tt>, <tt>org.apache.lucene.analysis.Token</tt>
  must always be fully qualified in source code in this package.
</body>
</html>
